DEVELOPING ANALYTIC RATING GUIDES FOR TOEFL IBT'S INTEGRATED SPEAKING TASKS

Automated Trait Scores for TOEFL® Writing Tasks

Construct validity in TOEFL iBT speaking tasks: Insights from natural language processing

This study explores the construct validity of speaking tasks included in the TOEFL iBT (e.g., integrated and independent speaking tasks). Specifically, advanced natural language processing (NLP) tools, MANOVA difference statistics, and discriminant function analyses (DFA) are used to assess the degree to which and in what ways responses to these tasks differ with regard to linguistic characteri...

Psychometric Characteristics of a Rating Scale for Assessing Interactional Competence in Paired-Speaking Tasks at Micro-level

Developing rating scales for assessing interactional performance is demanding since it is a relatively complicated procedure. The present study investigated the psychometric characteristics of the CAP rating scale (Wang, 2015) for assessing interactional competence at micro-level. To this end, 160 Iranian intermediate EFL learners were selected based on their performance on TOEFL iBT test from ...

TOEFL iBT integrated speaking tests: a comparison of test-takers' performance in terms of complexity, accuracy, and fluency

This study compares three integrated tasks of the TOEFL iBT speaking subtest in terms of complexity, accuracy, and fluency. To this end, a group of TOEFL iBT Iranian candidates took a simulated TOEFL iBT some days prior to their real exam. The collected oral responses were first transcribed and then quantified using software such as ‘Syllable Counter’ and ‘Coh-Metrix3’ for fluency and complexit...

Developing an Analytic Scale for Scoring EFL Descriptive Writing

English language practitioners have long relied on intuition-based scales for rating EFL/ESL writing. As these scales lack an empirical basis, the scores they generate tend to be unreliable, which results in invalid interpretations. Given the significance of the genre of description and the fact that the relevant literature does not introduce any data-based analytic scales for rating EFL descri...